Dynamic energy efficient data placement and cluster reconfiguration algorithm for MapReduce framework
نویسندگان
چکیده
منابع مشابه
Dynamic energy efficient data placement and cluster reconfiguration algorithm for MapReduce framework
With the recent emergence of cloud computing based services on the Internet, MapReduce and distributed file systems like HDFS have emerged as the paradigm of choice for developing large scale data intensive applications. Given the scale at which these applications are deployed, minimizing power consumption of these clusters can significantly cut down operational costs and reduce their carbon fo...
متن کاملAdaptive Dynamic Data Placement Algorithm for Hadoop in Heterogeneous Environments
Hadoop MapReduce framework is an important distributed processing model for large-scale data intensive applications. The current Hadoop and the existing Hadoop distributed file system’s rack-aware data placement strategy in MapReduce in the homogeneous Hadoop cluster assume that each node in a cluster has the same computing capacity and a same workload is assigned to each node. Default Hadoop d...
متن کاملEnergy Efficient Dynamic Cluster Algorithm for Ad Hoc Sensor Networks
An important issue in ad hoc sensor networks is the limited energy supply within network nodes. Therefore, power consumption is crucial in the routing design. Cluster schemes are efficient in energy saving. This paper proposes a new algorithm called dynamic cluster in which energy in the entire network is distributed and unique route from the source to the destination is designed. In this algor...
متن کاملDynamic Virtual Cluster Reconfiguration for Efficient IaaS Provisioning
Cloud computing is an emerging paradigm to provide Infrastructure as a Service (IaaS). In this paper we present NEPTUNE-IaaS, a software system able to support the whole lifecycle of IaaS provisioning in a Virtual Cluster environment. Our system allows interactive design of complex system topologies and their efficient mapping onto the available physical resources of a cluster. It also provides...
متن کاملA Simple and Efficient MapReduce Algorithm for Data Cube Materialization
Data cube materialization is a classical database operator introduced in Gray et al. (Data Mining and Knowledge Discovery, Vol. 1), which is critical for many analysis tasks. Nandi et al. (Transactions on Knowledge and Data Engineering, Vol. 6) first studied cube materialization for large scale datasets using the MapReduce framework, and proposed a sophisticated modification of a simple broadca...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Future Generation Computer Systems
سال: 2012
ISSN: 0167-739X
DOI: 10.1016/j.future.2011.07.001